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Abstract. The line of investigation of the present paper goes back to a classical work of 
W. H. Gustafson of the 1973, in which it is described the probability that two randomly 
chosen group elements commute. In the same work, he gave some bounds for this kind of 
probability, providing information on the group structure. We have recently obtained some 
generalizations of his results for finite groups. Here we improve them in the context of the 
compact groups. 



1. Introduction 

A compact group G admits a unique left Haar measure [1q which is normalized and left- 
invariant (see [TTJ Sections 18.1, 18.2, Proposition 18.2.1]). This allows us to assume that G 
has a unique probability measure space with respect to /ig (see [TTJ Sections 18.1, 18.2] or PJJJ 
Section 2]). On the product measure space G x G, it is possible to consider the product measure 
fJ-G x (J-G which is a probability measure. If 

C 2 = {{x,y)eGxG\ [z,i/] = 1}, 

then C 2 — / -1 (1), where 

/ : (x, y) S G x G h-> f(x, y) = [x, y] G G. 

Clearly, / is continuous and C 2 is a compact measurable subset of G x G. Therefore it is 
possible to define 

d(G) = (jjlg x mg)(C 2 ) 

as the commutativity degree of G. In the finite case d(G) is described in p~l [2l [3l [5l [T2l ri3l [T4] . 

We may extend the notion of d(G) as follows. Suppose that n > 1, G" is the product of n-copies 
of G and that of n-copies of \xq- We define 

d^\G) = ^ G +1 {G n+1 ) 

as the n-th nilpotency degree of G, where 

C n+ i = {(xi,...,x n+ i) e G n+1 | [xi,x 2 ,.:,x n+ i] = 1}. 

Obviously, if G is finite, then G is a compact group with the discrete topology and so the Haar 
measure of G is the counting measure. Then, for a finite group G, we have 



d(»)(G) = /4 +1 (G„ +1 )- |CWl1 



\G\ n + 1 ' 

See for details (5j[l3]. 

More generally, let H be a closed subgroup of a compact group G. We define 

D 2 = {(h,g)EHxG\ [h,g] = l] 

and note that D 2 — _1 (1), where 

<j> : (h,g) € H x G ^ <j>(h,g) = [h,g] e G. 
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Clearly, <fi is continuous and D 2 is a compact measurable subset of H x G. Note that <f> is the 
restriction of / to H x G and this shows that H has to be closed subgroup of G, if we want to 
preserve the topological structure. Then we define 

d(H,G) = x hg){D 2 ) 

as the relative commutativity degree of H with respect to G. Considering 

D n+ i = {(hi,,...,h n ,g) 6 H n x G \ [hi, h 2 , h n ,g] = 1}, 

we define 

d^{H,G) = { l i n H x l jL G ){D n+1 ) 
as the relative n-th nilpotency degree of H with respect to G. As already noted, fll f5l fT2l H~3l IT4] 



give contributions to the knowledge of the n-th nilpotency degree in case of finite groups. 
Recently, the case of infinite groups can be found in [H |H1 [7J [SJ M HH1 US] • We will try to extend 
the results in [SJ Sections 3,4,5] looking at the methods in [41 151 [71 151 [TBI. [TB] . 

2. Relative commutativity degree 
The next statement is useful for proving most of our results. 

Lemma 2.1. Assume that G is a compact group, H is a closed subgroup of G and C G {[hi, h n ]) 
is the centralizer of the commutator [hi, h n ] in G for some elements hi, ...,h n in H . Then 

d^(H, G) = J U H m{C G {[hi,...,h n ))WH{hi)\ ...d» H (h n ), 

where 

(J-G(Ca([hi, -,h n ])) = / x Dn , 1 (hi,-,h n ,g)diJ, G (g) 

JG 

and x D j denotes the characteristic map of the set D n+ i. 
Proof. Since 

m{Ca{[hi, -,h n })) = / Xn , 1 (hi,...,h n ,g)dfj, G (g), 

JG 

we have by Fubini-Tonelli's Theorem: 

S n \H, G) = ( M ff x ix G ){D n+ i) = I x Dn+i (d f i n H x dfi G ) 



..+1 

ff"xG 



HG(C G ([hi, ...,h n ])dfi,ff(hi) ) ... dfi H (h n ). 



H \J H / 

□ 

We recall the following elementary fact, which can be found in [TU]. See also [BJ Lemma 3.1]. 

Lemma 2.2. Assume H is a closed subgroup of a compact group G. If ' \G : H\ = n < 00, then 
fi G (H) = i. If \G : H\ = 00, then m {H) = 0. 

n 

Proof. Assume that \G : H\ = n is finite. Then G = |J &*J?. So we have 

n n n 

1 = MG (G) = mg(|J = $> G ^#) = 5>c(#) = nna(H) 
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and therefore fj, G (H) = ~ . Now assume that a = 
for some positive integer t. By assumption, G = 

subset J of I of cardinality t. It follows that 



\G : H | = oo. Of course, a > 0, then ta > 1 
1J giH, where I is an infinite set. Choose a 



1 = Mg(G) > mg(U > }Z^(9jH) = ta > 0. 

This contradicts fj, G (H) = and the proof of the lemma follows. □ 

Lemma 2.2 will be used in most of our proofs, even if the following form is more suitable. 

Lemma 2.3. Assume H is a closed subgroup of a compact group G. If \G : H\ > n, then 
fi G (H) < — • If \G : H\ < n, then fi G (H) > —. In particular, \G : H\ — n if and only if 

Proof. This follows from an argument as in Lemma 2.2. □ 

Lemma 2.3 allows us to reformulate [5] Theorem 3.10] for infinite groups in terms of the 
following result. The reader may find exactly the same proof in [15]: here we repeat it, just for 
sake of completeness and because we want to point out the methods and the ideas which are 
often used in similar circumstances. 

Theorem 2.4. Let H be a closed subgroup of a compact group G. 
(i) // d(H, G) = \, then H/{Z{G) n H) is cyclic of order 2. 

ii) If d(H 7 G) = | and H is nonabelian, then H/(Z(G) n H ) is 2-elementary abelian of 
rank 2. 

Proof, (i). Assume that d(H,G) = § and let K = H n Z(G). If h is a element of H not 
belonging to K, then \G : Cc(h)\ > 2 and so fiQ^Coih)) < \ by Remark 2.3. On the other 
hand, if h is an element of K, then /j,g(Cg(/i)) = 1. From these facts and Lemma 2.1, we have 

-=d{H,G)= f fi G (C G (h))d m (h) 
4 iff 

= / fJ, G (C G (h))dfx H (h)+ / ii G {C G {h))dii H {h) 

JK JH~K 

<[ d m (h) + \[ d m (h) = m(K) + l(i-m(K)). 

JK z JH-K 1 

Therefore, \ih (K) > | . On the other hand, if is a closed subgroup of the abelian group H 
such that hh{K) < h- Then hh(K) = i and so \H : K\ — 2. This means that H/K is cyclic 
of order 2, as claimed. 

(ii). Assume that d(H,G) = | and let K = H n Z(G). We may argue as in the previous 
statement (i). On a hand, we have | = d(H,G) < \ + ^^h{K)- Therefore, hh{K) > j- On 
the other hand, K is a closed subgroup of the nonabelian group H so that /j,h{K) < \, still by 
Lemma 2.3 . This gives /ih(K) — j so that \H : K\ = 4. This means that H/K has order 4. 
Since H is nonabelian, H/K cannot be cyclic. From this, H/K is 2-elementary abelian of rank 
2, as claimed. □ 

Note that [5J Theorem 3.10] follows from Theorem 2.4 when we consider a finite group with 
the counting measure on it. Now we extend [51 Lemma 3.2] to the case of infinite groups. The 
next result overlaps [SI Lemma 3.2]. 

Lemma 2.5. Let H be a closed subgroup of a compact group G. Then 

»g{C g {x)) < vh{Ch{x)) 

for all x E G. 
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Proof. Consider the map 

/ : hC H {x) e {hC H {x) \heH}^ f(hC„(x)) = hC G (x) e {gC G (x) | g G G}. 

/ is one-to-one and so \H : Ch(x)\ < \G : Cg(x)\. This implies iig{Cg{x)) < ^h(Ch(x)). D 

An important dominance condition is the following. 

Theorem 2.6. Let H be a closed subgroup of a compact group G. Then 

d(G) < d(H, G) < d(H). 

Proof. From Lemma 2.5, hh(Ch(x)) > hg{Cg{x))- Integrating over H and keeping in mind 
Lemma 2.1, we have 



d(H)= / HH(C H (x))d» H (x) > / HG(C G (x))dm(x)=d(H,G). 

J H J H 

On the other hand, Lemmas 2.1 and 2.5 give 

d(H,G)= f fiH(C H (x)W G (x) > I fx G (C G (x))dfx G (x) = d(G). 



□ 



Theorem 2.7. Let H be a closed subgroup of a compact group G. Then 

(i) d(G) < \ + y G {Z{G)); 

(ii) d(H,G) < \ + \li H {K), where K = HnZ(G). 

Proof, (i). By Lemma 2.1 and noting that hg{Cg{x)) < \ for each noncentral element x of G, 
we have 

d(G) - / pL G {C G {x))dnG{x) 



fi G (CG(x))d^G(x) + / ^ G (CG{x))dfi G (x) 

Z(G) JG-Z(G) 



= ^ G {Z{G))+ iiG{C G (x))diiG{x) 

JG-Z(G) 

< hg{Z{G)) + hg{Z{G))) = \ + \hg{Z{G)). 
(ii). By Lemma 2.1 and noting that /iGiCcih)) < \ for each element h of H — K, 

d(H, G) = f pL G {C G {h))dpL H {h) 

JH 

fiG{Ca(h))dfin(x) + / iiG(CG(h))dfiH(h) 

K JH-K 

= fi H (K)+ I iiG{C G (h))dn H {h) 

JH-K 

< m (K) + 1(1 - m (K)) = l - + \ m (K). 



□ 



Note that the upper bounds in [5j Theorem 3.5] follow from Theorem 2.7 when we consider 
a finite group with the counting measure on it. The lower bounds in [5j Theorem 3.5] cannot 
be true in the infinite the infinite dihedral group shows. 



Corollary 2.8. Assume that H is a closed subgroup of a nonabelian compact group G. 

i) IfH < Z(G), then d(H, G) = 1. 

(ii) If H £ Z(G) and H is abelian, then d(H, G) < f . 

(iii) If H j£ Z(G) and H is nonabelian, then d(H,G) < |. 
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Proof, (i). Obvious. 

(ii) . Since H % Z{G), K = H n Z(G) £ H. As in the proof of Theorem 2.4 (ii), we have 
Hh{K) < \. Theorem 2.5 (ii) implies d(H,G) <\ + \{\) = f. 

(iii) . We know from Theorem 2.6 and [10] that d(H,G) < d{H) < §. □ 

Note that Theorem 3.6] follows from Corollary 2.8 when we consider a finite group with 
the counting measure on it. 

Corollary 2.9. Let A and B be two closed subgroups of a compact group G such that A < B. 
Then d(A, B) > d(A, G) > d{B, G). 

Proof. As in the proof of Theorem 2.6, the condition 

\A:C A {x)\ < \B:C B {x)\ < \G : C G {x)\ 

implies the condition ha(Ca{x)) > hb{Cb{x)) > ^g{Cg{x)) for every element x of G. Inte- 
grating and keeping in mind Lemma 2.1, we have 

d(A,B)= [ ii B {C B {x))dn A {x) > 

J A 

d(A,G)= f vg(Cg(x)W a (x) > [ fx G (C G (x))dfi B (x) = d(B,G). 



□ 

Note that [SJ Theorem 3.7] follows from Corollary 2.8 when we consider a finite group with 
the counting measure on it. We recall to convenience of the reader [SJ Lemma 3.8]. 

Lemma 2.10. Let H and N be two closed subgroups of G such that N < H and N is normal 
in G. Then Ch(x)N/N < Ch/n{xN) for every element x of G. Moreover, the equality holds 
ifNf) [H, G] is trivial. 

Then we may formulate another interesting dominance condition as follows. 

Theorem 2.11. Let H and N be two closed subgroups of a compact group G such that N < H 
and N is normal in G. Then d(H, G) < d(H /N, G/N)d(N). In particular, the equality holds if 
N n [H, G] is trivial. 

Proof. Consider S — {g e G \H : Cjj(g)\ is finite}. We have 

d(H,G)= f m {C H {g))d l i G (g)= f m (C H (g))d» G (g) 

JG JS 

| Ch^N : (g) | dfiG ^ = J s ^ H ^ CH ^ N ^ N ^ CN ^ d ^ G ^- 
In the last equality we have used the argument just before Theorem 2.4 and the fact that 
\C H (g)N : C H {g)\ is finite, getting 

\C H (g)N : C H (g)\ = \N : C H (g) n N\ = 1 

tJ-N{C N {g)) 

Now we get: 

d(H,G)< f tx H {C H {g)N) l i N {C N {g))d l i G {g) 

JG 



HH{CH{gx)N)n N (C N {gx))d^N{x) dfj, G/N (gN). 

J 

By Lemma 2.10, fi H (C H (gx)N) = hh( Ch % x)N ^ < Mf (Ch (gN)), then 

d(H,G) < V G /N(C G/N (gN)) ^J^n N (C N (gx))dfi N (x)^ d^ G/N {gN). 
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On another hand, 

C 2 = {(x, y) ENxN\ [gx,y] = 1} = {(x,y) 6 N x N \ gx e C G (y)DgN}. 

If x € C G {y)C\gN ^ 0, then either gN = g n N or g = g t for some t E N, whence C G {y)C\gN = 
g {C G (y) n N) = g C N (y) and so 

C 2 = {(x, y)eNxN \ gxe g C N (y)} = {(x, y) e N x N \ x e tC N (y)}. 

Therefore 

/ n N (C N (gx))dn N {x) < / n N (tC N {y))da N {y) 

J N J N 

= / HN(C N (y))dn N (y) = d(N). 

JN 

Hence 

d(H,G) < d(N) f ^H(CH(gN))d^ G/N (gN) = d(N)d(H/N, G/N). 

In particular, if N n [H, G] = 1, then C H (g) = C H {g)N and so n H (C G {g)) = fi H (C H (g)N) 
for all g e G. Furthermore, we have 

m(C H (gn)N) = v G/N ( CHig ™ )N ) = Hg,n(C h/n ( 9 N)). 
Therefore each inequality becomes equality and so d(H, G) = d(H/N, G/N)d(N). □ 

3. Relative n-th commutativity degree 

The present section is devoted to extend some results of Section 2. For instance, the next 
statement extends the upper bound in Theorem 2.6. 

Theorem 3.1. If H is a closed subgroup of a compact group G, then 

d (n) (H,G) < d^{H). 

Proof. We may argue as in the proof of Theorem 2.6 in order to get 

HH{C H ([h-L,...,hn\)) > ii G (C G ([hi,...,h n ])). 

Integrating over H and keeping in mind Lemma 2.1, we have 

d {n) {H) = J h -- (J H f*H(C H ([hi,...,h n ]))d»H(hi?j ...dfi H (h n ) 
^ j H --(yj H »G(C G ([hi, • • • dn H (h n ) = S n \H, G). 

□ 

Note that Theorem 3.1 informs us that the sequence {d^ n \H, G)}„>i is increasing for any 
compact group G and any closed subgroup H of G. 

The evidences of the finite case and the considerations of many situations in the infinite case 
can be summarized in the following result. 

Theorem 3.2. If H is a closed subgroup of a compact group G and K = H n Z(G), then 
d^ n+1 \H,G) < ±(l + d^(H/K)y 

Proof. Let A = {(h u h n+1 ) e H n+1 | [h lt h n+1 ] e Z(G) n H} and B = H n+1 - A. Then 
S n+1 \H,G) = [ u G ([h 1 ,...,h n+1 ])d(n H ) n+1 

= / v G (\h 1 ,...,h n+1 ])d( j i H T+ 1 + f » G ([h 1 ,...,h n+1 })d(n H y+ 1 

J a Jb 
< » n H + \A) + \^ H +1 {B) < ^+\A) + 1(1 - f+\A)) = 1(1 + v H +1 (A)). 
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On the other hand, 

Vh + \ a ))= I ••• / li«{CH{[h l ,...,h n ]))d t i H {h l )...dii„{h n ) 



H JH 



HS-iCa ([/ii,...,/i„]))d^_R-(A:)d^_f/(/ii) ...dpL H (h n ) 



H 



M«(C 'nQhi, ...,h n ]))d^ H {hi) ...dfi H (h n ) 

H K K j 



^H(CH([h 1 ,...,h n ]))dfiH(h 1 )...d f lH(h n ) = d^(H/K). 

and the result follows. □ 

Note that Theorem 4.3] follows from Theorem 3.2 when we consider a finite group with 
the counting measure on it. Note that Theorem 3.2 is true also for groups of the form Ai x Bj, 
where Ai is a compact abelian (infinite) group, Bj is a finite group, i € I and j G J. 

Corollary 3.3. If G is a compact group, then d {n+1 \G) < |(1 + S- n \G/Z{G))). 

Proof. This follows from Theorem 3.2 with H = G. □ 

It is possible to bound d n+1 (G) as follows. 

Theorem 3.4. If G is a compact group, then 

d( n+1 \G)<y i (2 n -l + d(G/Z n (G))). 

Proof. We may repeat the proof of [5J Theorem 4.5], since we do not need that G is finite. We 
should only note that Z n {G)/Z{G) = Z„_i(G/Z(G)) is a closed subgroup of G/Z(G). □ 

Note that [5j Theorem 4.5] follows from Theorem 3.4 when we consider a finite group with 
the counting measure on it. Furthermore Theorem 3.4 is true for compact groups of the form 
A x B, where A is a compact abelian (infinite) group and B is a finite group. In such a case 
[5j Theorem 4.5] cannot be applied. 

Theorem 3.5. Let H and N be two closed subgroups of G such that N < H and N is normal 
in G. Then S n \H,G) < d^{H/N,G/N). In particular, the equality holds if N n [ n H, G] is 
trivial. 

Proof. Let A, pL and v be corresponding Haar measures on TV, G and G/N respectively. Consider 
S = {(hi,...,h n ) | \G:C G ([hi,...,h n ])\ fe finite}. Then 

dW(H,G) = f fx G (C G ([h 1 ,...,h n ]))dnl= f MG (C G ([fti,...,/i„]))d^ 

JH n JS 

fi G {C G ([hi,...,h n ])N) n 
\C G ([h 1 ,...,h n ])N:C G ([h 1 ,...,h n })\ Mh 

liaiC a ([hi, M)^W(C G ([/n, K]))dn% 
I ( i G (C G ([h U :,h n ])N)t m (C G ([h 1 ,...,h n ]))d(i T ! I 

fJ-G(C G ([hiai, h n a n ])N)n N (C G ([hiai, h n a n ])) 

I & JN J & J N 

N N 

dnN(ai)dfiii (hiN)...d[ip{(a n )dnH.(h n N). 

On the other hand, 

in nu u i\xn f C G {[hiai, h n a n ])N 
Mg(C G ([Mi, ...,h n a n \)N) =Mf ( jj ) 



H" 
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<Ha(Ca([htN,...,h n N})). 

Therefore 

d^(H,G) < f ... f HG/ N {C^([hiN,...,hnN])) 

HN(C G ([hiax, ...,h n a n ]))diJ, N (ai)d...dfi N (a n )fiH(hiN)...dfiH(h n N) 

n Jn n n 

< L- f n (CG([h 1 N 1 ...,h„N])) n (h 1 N)...d n ^ 



□ 



An easy consequence is the following. 

Corollary 3.6. If N is a closed normal subgroup of a compact group G, then d (n) (G) < 
dW(G/N). 

Proof. This follows from Theorem 3.5 with H = G. □ 

4. Weakening some bounds 

In the present section we will give some upper and lower bounds for d^ n \G) and d^ n '(H, G) 
by means of the results which have been previously found. 

Corollary 4.1. If G is a compact group which is not nilpotent of class at most n, then d^ n ' (G) < 

2"+ 2 -3 

Proof. G/Z n -i(G) is a nonabelian group by the assumptions. From |10) . 

d(G/Z n ^(G)) < |. 

Now Theorem 3.4 gives d^(G) < ^ T {2 n - 1 - 1 + |) = 2 '^ 3 . □ 

Note that Theorem 5.1] follows from Corollary 4.1 when we consider a finite group with 
the counting measure on it. 

Corollary 4.2. If G is a nontrivial compact group with trivial center, then d^ n \G) < 2 2 ~ 1 . 

Proof. Of course, Z n (G) is trivial for each n > 1. Thus G is a nonnilpotent group. In particular 
fi G (Z(G)) = so Theorem 2.7 (i) implies d(G) < \. Now the result follows by Theorem 3.4 by 
induction on n. □ 

Our last result improves Corollary 2.8 and extends Theorem 5.5]. 

Theorem 4.3. Assume that H is a proper closed subgroup of a nonabelian compact group G 
such that n > 1 and K = Z{G) D H . 

(i) If H < Z n {G), then d^(H,G) = 1. 

(ii) If H j£ Z n (G) and H/K is a nilpotent group of class at most n-1, then d^(H, G) = 1. 
(hi) If H j£ Z(G) and H/K is a nonnilpotent group of class at most n-1, then 

on+2 _ q 

d (n \H,G)< 2 -^±. 

Proof, (i). This is obvious. 

(ii) . Of course, if H/K is nilpotent of class at most n-1, then [x\, . . . ,x n ] — K for some 
elements x%, . . . ,x n of H/K. Therefore, G — Cg{[x\, ■ ■ ■ , x n ]) and we may argue as in Theorem 
3.2, getting d {n \H,G) = 1. 

(iii) . Using Corollary 4.1 and the fact that H/K is nonnilpotent of class at most n-1, we get 
d (n '^(H/K) < 2 ^t+I 3 ■ By Theorem 3.2, we get 

i i on+l _ q on+2 _ q 

d (n) (H,G) < \{l + d^\H/K)) < ^1 + 1—1) = 2 -^±. 

□ 
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